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A|pigital System and Method for Testing Analogue and 
Mixed- Signal Circuits or Systems 



FIELD OF THE INVENTION 

5 The present invention relates to a digital system and 

method for testing analogue and mixed-signal (analogue and 
digital) circuits or systems. 



BACKGROUND OF THE INVENTION 

10 Testing of circuits is an essential step in the 

manufacture of high quality and reliable electronic 
products. The cost of an electronic product is related to 
the cost of the tests and the time necessary to .generate 
and apply these. In terms of testing, mixed analogue and 

15 digital circuits, so called mixed-signal circuits, can be 
particularly time consuming and costly. Indeed, it has 
been reported that one of the greatest challenges in the 
coming years is the development of low-cost automatic test 
equipment for testing mixed-signal integrated circuits, 

20 see "International Technology Roadmap for Semiconductors'', 
1999, published by the Semiconductor Industry Association 
(SIA) . 

Analogue signals are continuous as a function of both 
time and amplitude. Therefore the amount of information to 

25 be processed during testing is potentially very large. 
Unlike digital systems, interpreting whether an analogue 
output signal does or does not actually indicate a fault 
can be ambiguous. This inability to discriminate is made 
worse by the greater functionality and complexity of even 

30 the simplest analogue circuit, particularly if input 
signals are limited in complexity or time duration. In 
addition, because output signals are analogue, there can 
be no ideal performance from a completely "correct" 
circuit. Instead all assessment must be based on the 
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concept that each component is subject to tolerances , 
which contribute towards variability in system behaviour 
even under fault-free conditions. All of these features 
make the testing of analogue circuits somewhat 
5 problematic - 

One of the main problems with testing mixed-signal 
circuits is the need for separate analogue and digital 
test instruments. Over the past few years , a number of 
approaches have been proposed to unify the test method for 

10 mixed-signal systems. These approaches include power * 
supply monitoring, digital modelling of analogue circuits 
and the use of digital test signals. As regards the use of 
digital signals , a number of techniques have been 
suggested, for example step response testing. This is 

15 described by Souders et al in the article "Accurate 
Frequency Response Determinations from Discrete Step 
Response Data", IEEE-Trans. on Instrumentation and 
Measurement, Vol. IM-36, No. 2, pp. 433-9, June 1987.- 
Testing using a complementary signal set is another 

20 proposed method for digital testing of analogue circuits. 
This is described by Eckersall et al in the article 
"Testing an Analogue Circuit using a Complementary Signal 
Set", IEE Colloquium on "Testing Mixed Signal Circuits", 
Digest No. 1992/118, pp. 5/1-5/6, 1992. Pseudorandom 

25 testing is yet another option. Examples of this are 
described by: a) Al-Qutayri et al in "Go/No-Go Testing of 
Analogue Macros", IEE Proc. Circuits, Devices and Systems, 
Vol. 139, No. 4, pp. 534-540, Aug. 1992; b) Pan et al in 
"'Pseudorandom Testing for Mixed-Signal Circuits", IEEE 

30 Trans, on Computer-Aided Design of Integrated Circuits and 
Systems, Vol. 18, No. 10, pp. 1173-1185, Oct. 1997, and c) 
Variyam et al in "Digital-Compatible BIST for Analog 
Circuits Using Transient Response Sampling", IEEE Design & 
Test of Computers, pp. 106-115, July-Sep. 2000. 
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Existing digital approaches for testing mixed-signal 
systems have had limited success. Nevertheless, because 
of the advantages of using a digital signal to test mixed- 
signal circuits, significant and continuing efforts are 
5 being made to investigate this. However, despite extensive 
research, a satisfactory solution to the problem of how to 
test analogue and/or mixed-signal circuits using a digital 
signal has not been found. 

An object of the invention is to provide an improved 
10 method and system for digital testing of analogue and 
mixed-signal circuits . 

SUMMARY OF THE INVENTION 

The invention is based on the realisation that the 
15 specific nature of the digital test signal applied to an 
analogue or mixed signal circuit is key to successful 
testing. Hence, the test signal must be carefully 
optimised on a per circuit basis in order to ensure that 
faults can be detected quickly and accurately. Once the 
20 optimised test signal is obtained, a very simple set up 
can be used in the test application mode, during which 
real circuits are tested. It is envisaged that the real- 
time testing of circuits during manufacture would be 
automated. 

25 According to a first aspect of the present invention, 

there is provided a method of optimising a digital test 
signal for testing an analogue or mixed-signal circuit 
using a suitable optimisation algorithm. The optimisation 
process aims to identify or design the optimum digital 

30 signals for use in the testing method, such that all or at 
least most of the defects that may occur during 
manufacture stage can be robustly identified. The method 
comprises applying a plurality of different digital inputs 
to a fault free circuit and a faulty circuit, preferably 
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software-based simulations of the fault free and faulty 
circuits; monitoring the corresponding . outputs of the 
fault free and the faulty circuits for each input, and 
using the outputs produced to identify an improved test 
5 input and iteratively repeating this to as part of an 
optimisation procedure, thereby to identify an optimum 
input. The method may further comprise determining a 
measure, for example a figure of merit, that is indicative 
of potential differences between output responses of a 

10 fault free and a known faulty circuit to a digital input 
signal; varying the input digital signal; calculating a 
measure, e.g. a figure of merit, using the output 
responses of the fault free and the known faulty circuit 
to the varied input signal; and selecting an improved test 

15 signal based on the determined figures of merit. 

The method is implemented using a computer-based 
simulation of the fault free and faulty circuits. 
Preferably, the selected input signal has a maximum figure 
of merit. Preferably, the process of varying is repeated 

20 a plurality of times, thereby to determine the best 
variation of the initial test signal. Preferably the 
signal is varied according to pre-determined criteria. By 
appropriately selecting, for example by maximising the 
figure of merit, an optimum digital test signal can be 

25 found for identifying circuits that have the known fault. 

The method may involve testing a range of different 
initial starting input digital test signals, each of these 
being varied as set out above to find a local optimum. 
Once this is done, the method may then further involve 

30 comparing all of the local optima and their corresponding 
figures or merit and selecting the signal with the' best 
overall figure of merit. 

The figure of merit may be determined using analogue 
outputs for each of the fault free and the known faulty 
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circuit. An advantage of using the analogue response is 
that it naturally guides the search for a test signal 
towards an optimum value. The figure of merit that is 
derived from the analogue responses contains information 

5 about potential improvements in the digital figure of 
merit that is used in the actual test mode. A further 
advantage is that the analogue figure of merit is 
relatively immune to the effects of noisy or very small 
responses. Prior to determining the figure of merit, the 

10 analogue signal may be processed to prevent domination of 
large differences in the output. This avoids the 
optimisation increasing further any instantaneous values 
of difference in amplitude between the two .analogue 
signals once that difference is sufficiently large to 

15 provide adequate discrimination. This can be achieved by 
applying to the signal a function having an output that 
saturates at two different predetermined values (often -1 
and +1) for extreme negative and positive values of input. 
In between these saturation regions, the function should 

20 increase monotonically, and hence be single-valued. An 
example of a suitable function is the sigmoidal function, 
which employs a non-linear squashing function based on the 
sigmoid or logistic equation. More specifically, the 
hyperbolic tan function (tanh) may be used. 

25 Additionally or alternatively, the analogue signal 

may be processed to take into account acceptable 
variations in the output caused by device tolerances. 

The figure of merit may be determined using digital 
outputs from the circuit under test (CUT) . 

30 The figure of merit may be a fault detection ratio, 

which is defined as the proportion of a set of predefined 
faults that can actually be detected according to a set of 
criteria for fault discrimination. A fault detection 
ratio of unity is the ultimate objective of the 
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optimisation process. The figure of merit may be the 
Hamming distance between the digital output response for 
the fault free circuit and the output response for the 
faulty circuit. The figure of merit may be proportional to 
5 or a function of the Hamming distance. Additionally or 
alternatively, the figure of merit may be a composite of 
some or all of the above. 

The method may further involve determining a figure 
of merit for each one of a plurality of different faulty 

10 circuits, each of these figures of merit being indicative 
of potential differences between output responses of the 
fault free and modelled faulty circuits, and determining a 
composite figure of merit using each of these. . In this 
case, the composite figure of merit represents the ability 

15 of an applied test signal to effectively detect the 
presence of faults in the CUT. The modelled faulty 
circuits may include circuits that have faults on a single 
component/parameter or on multiple components/parameters. 
This is advantageous. Of course, it will be appreciated 

20 that in practice to optimise this approach, it is 
necessary to select the most common or expected 
combination of faults for a given circuit. 

The process of varying the input digital signal may 
involve changing the length of one or more individual 

25 pulses in the applied digital input signal. The length of 
individual pulses may be varied by the same amount or by 
increasingly large or small amounts or by different 
amounts, which different amounts may be selected randomly 
or according to predefined criteria. The length (time- 

30 duration) of all of the pulses may be varied by the same 
amount in sequence one after the other, a figure of merit 
being determined each time one pulse length is changed. 
Once this is done and in the event that a sequence having 
an improved figure of merit is not determined, the method 
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may further involve changing the size of the amount by 
which the pulse lengths are varied and repeating the 
process of varying. 

Additionally or alternatively, the process of varying 

5 the input digital signal may involve applying a pre- 
determined function to the input sequence, such as a 
pattern shift function, which function in effect modifies 
all pulses in the input pattern at once. The step of 
applying a pre-determined function to the input sequence 

10 may occur after an improved sequence is found by varying 
the individual pulse lengths. 

Additionally or alternatively, exhaustive evaluation 
of the figures of merit for all possible sequences of 
limited length (number of bits, each bit of certain time- 

15 duration) may be used to find good initial or starting 
sequences. In order to achieve this, the process of 
varying may involve varying the frequency of the input 
signal, the frequency being defined by the reciprocal of 
signal time-duration. The frequency may be incrementally 

20 varied by a pre-determined amount over the bandwidth of 
the CUT. For each frequency, for each length and for each 
possible sequence a figure of merit is determined. The 
signal with the highest figure of merit is selected and 
preferably used as the initial input signal. In this way, 

25 a coarse search for a starting sequence can be done. 
Random starting sequences may also be employed. 

Additionally or alternatively, the method in which 
the invention is embodied could be used to determine the 
functional performance of CUTs. To do this, rather than 

30 optimising the input signal based on known faults, the 
signal is optimised to take into account variations in 
values of functional specifications. This would involve 
transforming the deviation in CUT specifications to a 
corresponding deviation in components values. In this 
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way, not only the presence of a fault could be detected 
but also the deviation of one or many of the CUT 
specifications could be detected. 

According to another aspect of the invention, there 

5 is provided a digital test signal or of a copy thereof for 
testing analogue or mixed signal circuits that is a 
product of the method in which the first aspect of the 
invention is embodied. 

According to yet another aspect of the invention, 

10 there is provided a method for testing analogue and/or 
mixed-signal circuits using a digital signal, the method 
comprising applying to the CUT an optimised test signal as 
determined using the method in which the first aspect of 
the invention is embodied; comparing an output of the CUT 

15 with an expected output for a good circuit and determining 
a fault based on a result of the step of comparing. In the 
event that the outputs are substantially the same, within 
an accepted tolerance range, this indicates that the CUT- 
is fault free. In the event that the outputs are 

20 different, these differences lying outside the accepted 
tolerance range, this indicates that the CUT is faulty. 

The outputs from the CUT may be analogue. The method 
may further involve digitising the output of the CUT, 
wherein the step of comparing may involve comparing the 

25 digitised outputs. The digitising of the output of the CUT 
may involve one or multiple quantisation levels. 

The method may further involve storing an output for 
a fault free CUT with an acceptable tolerance, range for an 
optimised input test signal and comparing the stored 

30 output with the actual output of the CUT. The stored and 
actual outputs may be digitised. The step of comparing 
the stored and actual digital outputs may comprise 
calculating the Hamming distance between them. 
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The method may further comprise storing outputs for 
one or more known faults for the optimised digital test 
signal and comparing an output from a circuit under test 
with these, so that in the event that there is a match, 
5 this indicates not only that there is a fault but possibly 
also the nature of that fault. Preferably, the stored 
outputs for the one or more known faults include an 
acceptable tolerance range for the applied optimised input 
test signal. In this way, a faulty circuit that has one 

10 faulty component and variations in its other component 
values due to tolerances can be identified. 

In the event that the gain of the circuit is to be 
tested, the method may further involve modifying the input 
offset voltage and/or the amplitude of the digital test 

15 signal. Preferably, this is done in conjunction with the 
output threshold level. 

According to yet a further aspect of the present 
invention, there is provided a system for optimising a 
digital test signal for testing an analogue or mixed- 

20 signal circuit using a digital signal, the system 
comprising means for determining a figure of merit that is 
indicative of differences between responses of a fault 
free and a faulty analogue or mixed signal circuit to an 
input digital signal; means for varying the input digital 

25 signal; means for determining a figure of merit for the 
varied input signal, and means for selecting an optimum 
test signal based on the determined figures of merit. 
Preferably, the means for selecting are operable to 
determine and select the input signal that has the maximum 

30 figure of merit. Preferably, the means for varying are 
operable to vary the input signal a plurality of times, so 
that a range of signals are tried, each of these being 
derived from the starting input. Preferably, the input 
signal is varied according to pre-determined criteria. 

9 
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The means for determining the figure of merit may be 
operable to use analogue outputs from the CUT. The means 
for determining the figure of merit may be operable to use 
digital outputs from the CUT. 
5 The system may further comprise means for determining 

a figure of merit for each one of a plurality of different 
faulty circuits and determining a composite figure of 
merit combining all of these. 

The means for varying the input signal may comprise 
10 means for changing the length of one or more individual 
pulses in the applied digital input signal. The means for 
changing the length of individual pulses may be operable 
to vary the pulse length by the same amount or by 
increasingly large or small amounts or by different 
15 amounts, which different amounts may be selected randomly 
or by predefined scheme. 

Additionally or alternatively, the means for varying 
may comprise means for varying the frequency of the input- 
digital signal, the frequency being defined by the 
20 reciprocal of signal time-duration. 

According to still another aspect of the invention, 
there is provided a system for testing analogue and/or 
mixed-signal circuits using a digital signal, the system 
comprising means for applying to the circuit under test an 
optimised test signal as determined using the method in 
which the first aspect of the invention is embodied; means 
for comparing an output of the CUT with an expected output 
for a good circuit and means for determining a fault based 
on an output from the means for comparing. In the event 
that the outputs are substantially the same, within an 
accepted tolerance range, this indicates that the CUT is 
fault free. In the event that the outputs are different, 
these differences lying outside the accepted tolerance 
range, this indicates that the CUT is faulty. 
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The outputs from the CUT may be analogue. Means may 
be provided for digitising the outputs of the CUT and the 
means for comparing may be operable to compare the 
digitised outputs. 
5 According to a still further aspect of the present 

invention, there is provided a computer program for use in 
a method of testing an analogue or mixed-signal circuit 
using a digital signal, the computer program being 
provided preferably on a data carrier or computer readable 

10 medium and having code or instructions for determining a 
figure of merit that is indicative of potential 
differences between output responses of a fault free and a 
known faulty circuit in response to a digital input 
signal; varying the input digital signal according to pre- 

15 determined criteria; calculating another figure of merit 
that is indicative of differences between the outputs of 
the fault free and the known faulty circuits in response 
to the varied digital input signal; and selecting an 
optimum test signal based on the determined figures of 

20 merit. Preferably, the selected input signal has a maximum 
figure of merit. Preferably, the step of varying is 
repeated a plurality of times, thereby to determine the 
best test signal. 

The computer program may have code or instructions 

25 for modelling output responses for the fault free and 
faulty circuits. 

The various figures of merit may be determined using 
analogue outputs from each of the fault free and the 
faulty circuits. The figure of merit may be determined 

30 using digital outputs from the CUT. The figure of merit 
may be the fault detection ratio. The figure of merit may 
be the Hamming distance between the digitised output 
response for the fault free circuit and the output 
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response for the known faulty circuit. The figure of merit 
may be a composite of some or all of the above. 

The computer program may have code or instructions 
for determining a figure of merit for each one of a 
5 plurality of different faulty circuits, each of these 
figures of merit being indicative of differences between 
output responses of the fault free and faulty circuits, 
and determining a composite figure of merit using each of 
these. 

10 The code or instructions for varying the input signal 

may be adapted to change the length of one or more 
individual pulses in the applied digital input signal. 
The length of individual pulses may be varied by the same 
amount or by increasingly large or small amounts or by 

15 different amounts, which different amounts may be selected 
randomly or according to a predefined scheme. The length 
of all of the pulses may be varied by the same amount in 
sequence one after the other, a figure of merit being 
determined each time one pulse length is changed. 

20 Additionally or alternatively, the code or 

instructions for varying, may be adapted to apply a pre- 
determined function to the input sequence, such as a 
pattern shift function, which function in effect modifies 
all pulses in the input pattern at once. The pre- 

25 determined function may be applied to the input sequence 
after an improved sequence is found by varying the pulse 
lengths , 

Additionally or alternatively, exhaustive evaluation 
of the figures of merit for all possible sequences of 
30 limited length (number of bits) may be used to find good 
initial or starting sequences. The code or instructions 
for exhaustive evaluation may be operable to vary the 
frequency of the input signal, the frequency being defined 
by the reciprocal of signal time-duration. The frequency 
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may be incrementally varied by a pre-determined amount 
over the bandwidth of the CUT. For each frequency, for 
each length and for each possible sequence a figure of 
merit is determined- The sequences with the highest 

5 figure of merit are selected and preferably used the 
initial input signals. 

According to still another aspect of the invention, 
there is provided a computer program for use in a method 
of testing an analogue or mixed-signal circuit using a 

10 digital signal, the computer program being provided 
preferably on a data carrier or computer readable medium 
and having code or instructions for applying to a CUT a 
test signal as determined using the method in which the 
first aspect of the invention is embodied; comparing an 

15 output of the CUT with an expected output for a good 
circuit and determining whether there is a fault based on 
an output from the means for comparing. 

The outputs from the CUT and the fault free circuits- 
may be analogue. The computer program may be operable to 

20 use digitised outputs of the CUT and fault free circuits 
when comparing the fault free and CUT outputs. 

The method may further involve storing a figure of 
merit for a circuit having a known fault and comparing the 
figure of merit for the CUT with that for the known fault. 

25 In the event that there is a match, this indicates not 
only that there is a fault but the nature of that fault. 
This is advantageous. 

According to another aspect of the invention, there 
is provided a test system that includes means for 

30 generating an optimised digital test signal as determined 
using the method of the first aspect of the invention, 
means for applying the digital test signal to an analogue 
or mixed-signal CUT, means for comparing an output of the 
CUT with an expected output for a good circuit, which is 
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also stored or generated locally, and means for 
determining a fault based on an output from the means for 
comparing. 

The outputs from the CUT may be analogue. Means may 
5 be provided for digitising the outputs of the CUT and the 
means for comparing may be operable to compare the 
digitised outputs. 

The above mentioned test system may be provided on 
the same chip as the CUT. The test system may be provided 
10 as a self-test facility. 

According to yet another aspect of the present 
invention, there is provided a electronic device, such as 
a mobile telephone, that includes a test system that has 
means for generating an optimised digital test signal as 
15 determined using the method of the first aspect of the 
invention, means for applying the digital test signal to 
an analogue or mixed-signal CUT, means for comparing an 
output of the CUT with an expected output for a good 
circuit, which is also stored or generated locally, and 
20 means for determining a fault based on an output from the 
means for comparing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Various aspects of the invention will now be 
25 described by way of example only and with reference to the 
accompanying drawings, of which: 

Figure 1 is a block diagram of a test system for 
testing analogue or mixed-signal circuits; 

Figure 2 shows various examples of analogue responses 
30 and their corresponding one-bit quantised responses, (a) 
before and (b) after the comparator in Figure 1; 

Figure 3 shows various analogue signals and their 
digital responses for a fault free CUT and a faulty 
version thereof; 
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Figure 4 is a block diagram of an arrangement for 
determining a figure of merit for a faulty circuits- 
Figure 5 shows the effect of applying a sigmoidal 
function to an analogue signal in the arrangement of 
5 Figure 4; 

Figure 6 shows various analogue responses due to 
tolerances within a test circuit; 

Figure 7 is an example of the tolerance limits of 
Figure 6; 

10 Figure 8 shows the maximum, nominal and minimum 

envelops of the tolerance responses of Figure 6/ 

Figure 9 is a block diagram of a system for measuring 
a composite figure of merit for a circuit that may have 
various potential faults; 
15 Figure 10 is a flow diagram of an algorithm for 

optimising selection of an input signals- 
Figure 11 is an example of a binary sequence of n 
runlengths; 

Figure 12 is a 3-D representation of a hill-climbing 
20 surface that is generated using simplified sequences of 

only two runlengths (a high and a low pulses) ; 

Figure 13 is a circuit diagram of a low pass filters- 
Figures 14(a) to (c) show the frequency responses for 

a fault free version of the filter of Figure 13, various 
25 different versions of the circuit of Figure 13, but within 

tolerance ranges and different faulty versions of the 

circuit of Figure 13; 

Figure 15 shows various waveforms for fault free and 

faulty versions of the circuit of Figure 13 (without 
30 tolerances) ; 

Figure 16 shows a table of simulation results for the 

filter of Figure 13, also without tolerances; 

Figure 17 shows an example of a test signal and its 

responses for gain measurement of a CUT; 
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Figure 18 is a chart that summarises the overall 
features of the optimisation technique and test method, 
and 

Figure 19 is a modified version of a test circuit for 
5 testing a plurality of sub-systems using a single digital 
source . 

DETAILED DESCRIPTION OF THE INVENTION 

The aim of mixed-signal testing is to detect 
10 • manufacturing defects. Integrated circuits can have two 
types of permanent faults, namely catastrophic or 
parametric faults. A catastrophic fault is one in which 
the component is destroyed, for example by virtue of a 
short circuit, an open circuit or a topological change. 
15 With parametric faults, the component continues to 
function, but outside the nominal tolerance band. 
Examples of faults that have to-be detected include: short 
circuit, open circuit, positive deviation from fault free 
behaviour and negative deviation. By choosing a suitable 
20 binary test signal, these can be identified. 

In accordance with the present invention, two modes 
of operation have to be carried out in order to test 
mixed-signal circuits. Firstly, a test development mode 
is conducted to determine the optimum test signal. When a 
- 25 suitable test signal is identified, a test application 
mode uses that optimised signal to test circuits. This is 
done by applying the signal to the CUT and monitoring its 
response. 

The test development mode includes three basic steps, 
30 these being determination of a potential fault list, 
identification of an efficient input test pattern, and 
storage of a threshold for fault detection. The efficient 
input test pattern is used to derive a reference output 
pattern for the fault-free CUT, Every CUT has unique input 
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and output reference patterns. These circuit-dependent 
reference patterns are stored in a database. When the test 
development mode is completed, the test application mode 
is entered. At this stage, a similarity or comparison 
5 measurement between the actual response of a circuit and 
the stored reference pattern is performed. If they are 
sufficiently different, then the CUT is declared faulty. 
Otherwise, the circuit is deemed acceptable. 

Figure 1 shows a circuit for digital testing * of 
10 analogue and/or mixed-signal circuits. This has a digital 
signal generator 10 for applying a digital test signal to 
the mixed-signal circuit 12 that is to be tested. The 
test signal 14 is a periodic discrete interval binary 
sequence of N bits. By this it is meant that the input 
15 signal can change between the two possible levels only at 
discrete intervals of time, which intervals are normally 
equally spaced. This is done in order to limit the 
complexity of the simulation ' and the amount of information 
generated. This is not a fundamental limitation, but is 
20 nevertheless a useful practical requirement. For the 

sake of simplicity, the input sequence 14 may be kept as 
simple as possible and hence the corresponding discrete 
interval of time will be no shorter than required to 
characterise the circuit together with expected faults. 
25 The methodology for identifying an optimum input signal- is 
described later. 

This input test sequence is fed through a buffer from 
a digital signal generator and into the CUT. Connected to 
the output of the CUT is a comparator 16 for comparing the 
30 CUT output signal with an optimised threshold. The 
comparator 16 is in turn connected to processor 18 that 
has access to a memory 20 in which are stored the 
reference outputs for a fault free version of the CUT, as 
well as reference outputs for circuits with known faults. 
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Whilst not shown on Figure 1, it will be appreciated that 
the system must be synchronised to a master clock so that 
testing is performed with synchronised input/output binary 
sequences. In addition, the comparator output must be 

5 digitised faster than the clock speed of the input 
sequence for precise recording of the zero crossings. 

When a circuit is to be tested, the digital test 
signal is applied to it. The resulting output signal from 
the CUT is analogue. This is passed to the comparator for 

10 processing. The comparator 16 in effect reduces the 
analogue response of the CUT to threshold crossings 
recorded against time. The output of the comparator 16 is 
either logic high or logic low depending upon the result 
of comparison between the CUT response and the comparator 

15 16 threshold and so is a binary sequence of Os and Is that 
is indicative of the digital response of the circuit. 
Examples of (i) analogue responses from the CUT and (ii) 
the corresponding one-bit quantised responses from the 
comparator 16 are shown in Figures 2(a) and (b) . 

20 The binary signal output from the comparator 16 is 

then passed to the processor 18 for comparing it with the 
stored reference binary sequence for a substantially fault 
free CUT. More specifically, the two binary signals are 
compared and the Hamming distance between them is 

25 calculated. The Hamming distance between two binary 
sequences is the number of digits in one of the two 
sequences that have to be changed to make it the same as 
the other. This task may be alternatively accomplished 
using combinational logic circuitry. 

30 In the event that the output from the test circuit 

and the stored sequence are the same, within a pre- 
determined limit, i.e. the Hamming distance is 
substantially zero, this indicates that the circuit is 
acceptable. In contrast, should the output and the stored 
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sequence be different, i.e. should the Hamming distance be 
non-zero, this indicates that the tested CUT is faulty. 
In this event, an alarm is raised and the circuit is 
designated as being faulty. Hence, by means of a one-bit 
5 quantisation, a straightforward, cost effective and fast 
means of detecting faults is provided. It should be noted 
that in practice, differences in some timeslots due to 
component tolerances are non-diagnostic and are excluded 
from the evaluation. This will be discussed in more 

10 detail later. 

The key to successful testing of an analogue or 
mixed-signal circuit is the rapid detection of as many 
potential faults as. possible. A good digital input 
sequence detects all or at least most of the considered 

15 faults for a particular circuit. Therefore, in order to 
optimise testing, it is necessary firstly to find the best 
binary sequence for inputting to the CUT to detect faults. 
This can be done by exploring the behaviour of all 
possible sequences that meet specified criteria. The 

20 strategy used to do this is to develop a test 
methodology using a computer-based simulation of the 
circuit-under-test. The principal reason for simulating 
the performance of circuits is to enable direct control 
over fault conditions, which control cannot be achieved 

25 with hardware. Other reasons are speed of execution and 
flexible facilities to automate the entire design 
process. Furthermore, diagnostic information is available 
which could not practicably be accessed on real hardware. 
It is important also that there should be control over 

30 tolerances. Again, this cannot be achieved with real 
components. Feasibility of this approach requires 
availability of software to determine the output of any 
specified circuit to any specified input signal. 
Commercial software for doing this, generally based on 
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methodology known as Spice, has been available for many 
years. This can be adapted to put the method in which the 
invention is embodied into practice. 

To identify an optimised test signal, a multi- 
5 dimensional hill climbing search algorithm is implemented. 
This algorithm uses a figure of merit as a measure of how 
good an input signal is at detecting faults. In order to 
limit the complexity of the calculations and amount of 
information, the input signals used are discrete interval 
10 binary sequences, i.e. they change between the two 
possible levels only at discrete intervals of time, which 
intervals are normally equally spaced. As noted before, 
this is not a fundamental limitation, but is nevertheless 
a useful practical requirement. Ideally, the input 
15 sequence should be kept as simple as possible and hence 
the corresponding discrete interval of time will be no 
shorter than required to characterise the circuit together 
with expected faults. 

In the present case, the figure of merit is a measure 
20 of the effectiveness of a binary input sequence in 
detecting faults. The input sequence with the maximum 
figure of merit is considered the best. Hence, the main 
objective of the optimisation procedures is to find the 
maximum value of the f igure-of -merit and the coordinates 
25 of the binary sequence for which this value is achieved. 

In practice, the figure of merit could be extracted 
from either the analogue response that is output directly 
from the CUT or from a one-bit digitised response that is 
provided by passing the analogue signal through a 
30 comparator, thereby providing analogue and digital figures 
of merit AFM and DFM respectively. These are related as 
can be shown from the following analysis. 

Assume that x 0 (t) and x x (t) are the analogue responses 
of a fault-free CUT and a faulty circuit, and y(t) is the 
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negative part of their product. y(t) can be defined as 
follows: y(0=x 0 (t)*x } (t) for x 0 (t)*x } (t) < 0, and y(t)=0 elsewhere. 
Since a negative product indicates a point in y(t) at which 
the fault-free response x Q (t) and the faulty response x } (t) 
5 have different polarities, then y(t) is indicative of the 
number of time slots at which x 0 (t) and x,(/) differ in 
polarity. Figure 3 shows examples of these signals. The 
polarity differences are related to the digital Hamming 
distance between the one-bit digitised responses of the 
good and faulty responses x 0 (t) and jc,(f) respectively. 

Furthermore, they contain intermediate information that 
can guide the search for an optimum input signal. 

The continuous AFM is a function of y(t) and can be 
expressed as follows: 

T 

AFM = \y{t)it 
o 

where T is the period of the steady state response. In 
the computer simulation, the continuous signals are 
sampled at discrete time intervals. The sampled AFM can 
then be described as: 

AFM^yii) 

where: XO = *o(0**i(0 for x 0 (i)*x x (i) <0 , i:l to number of 
samples n and y(i)=0 elsewhere 

The DFM is the number of samples at which the product 
*o(0**i(0 is negative. The AFM is the sum of the samples 
at which the product x 0 (i) **,(/) is negative and can be 
rewritten as: 

n 

DFM " 

AFM = -—Yy(i) = DFM**—- = DFM * NA 
DFM ^ DFM 

where NA is the sum of the negative values of the product 
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y(i) divided by the number of these negative values, which 
is the DFM. This shows that there is a direct relationship 
between the AFM and the DFM. Furthermore, it shows that 
the AFM inherently includes the DFM. 
5 As will be appreciated from the above analysis, very 

small and very large values of y(t) have the same value of 
DFM making it vulnerable to noisy signals. In contrast, 
the AFM is relatively immune to noisy signals. In 
addition, in practice it is found that analogue 

10 information in effect guides the hill-climbing search for 
a test signal naturally towards an optimum solution. This 
is because the AFM takes account of sections where the 
signals approach the threshold. As shown in Figure 2, the 
dip in the first analogue response is close to the 

15 comparator level. A small incremental change of the input 
binary sequence may pull this dip down and change the 
digital response, as shown in the second analogue response 
of Figure 2, which may increase the Hamming distance. 
This directive information is not available in the digital 

20 responses. Consequently, the figure-of -merit should 
preferably be extracted from the analogue responses and 
should be directly related to the digital Hamming 
distance, which is used in the test application mode to 
identify faults. Hence, in the test development stage, 

25 the AFM is used as a measure of the effectiveness of a 
given binary sequence in detecting faults. However, after 
finding the optimum input sequence using the AFM in the 
test development mode, typically the DFM is calculated and 
used during the test application mode to identify faults. 

30 Figure 4 shows an arrangement for detecting 

differences between a single faulty response and a good 
response using the AFM. This is a diagrammatic 

representation of methodology that is implemented in 
software. Hence, whilst it shows blocks of components 
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such as multipliers and comparators, it will be 
appreciated that physical components are not used, but 
instead are modelled using computer-based software. 

The arrangement of Figure 4 includes an input 22 for 
5 receiving a signal from a good CUT, an input 24 for 
receiving a signal from a faulty CUT and a comparator 26. 
The comparator threshold level is a DC voltage, based on 
which a comparison is made. During calculation of the 
figure of merit in the optimisation procedure of the test 
10 development mode, multiple values for the comparator 
threshold are used and the one which yields highest figure 
of merit is selected. The comparator threshold level is 
subtracted from each of the input signals at respective 
summers 28 and 30. If x Q (t) is the nominal analogue 
response for the good CUT and Comp is the comparator 
threshold level, the signal of interest is the difference 
between them. This difference {x 0 (t) - Comp) indicates 
whether x Q (t) is greater than Comp or not. 

When the difference (this difference is represented 
by the negative values of the product of two traces) 
between instantaneous amplitudes of the fault-free and 
faulty analogue response is sufficiently large to provide 
adequate discrimination, a procedure is carried out to 
prevent the figure of merit from increasing further at 
localised difference. This can be achieved by applying a 
function, for example a companding function 32 and 34, to 
each signal for preventing unnecessarily large 

differences in the output dominating the figure of merit 
during optimisation. The main requirement for this 
function are that the output should saturate at two 
different predetermined values (often -1 and +1) for 
extreme negative and positive values of input. In between 
these saturation regions, the function should increase 
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monotonically, and hence be single-valued. An example of a 
suitable function is the sigmoidal function, which employs 
a non-linear squashing function based on the sigmoid or 
logistic equation. Low inputs are mapped to values near 

5 the minimum activation, and high inputs are mapped to 
values close to the maximum activation. Intermediate 
inputs are mapped non-linearly between the activation 
limits. It should be noted that the sigmoidal function 
is equivalent to the standard sigmoid function when 

10 activations range from 0 to 1 and the standard hyperbolic 
tangent function when activations range from -1 to +1. 

Applying a sigmoidal function to the signal of Figure 
4 prevents domination of large differences in the. output. 
This procedure avoids the optimisation increasing further' 

15 any instantaneous values of difference in 
amplitude between the two analogue signals once that 
difference is sufficiently large to provide adequate 
discrimination. Otherwise the optimisation process might- 
continue to increase these localised differences even 

20 further at the expense of establishing an adequate 
difference at other times within the same signals. 

The hyperbolic tangent function (tanh) is used as an 
example of the sigmoidal function, although other 
functions might be equally applicable. The nominal signal 

25 xc Q (t) is then defined by: 

xc 0 (t) = tanh{[x Q (t)-Cornp]/x s } 

where x 3 is the input saturation level. For example, the 
30 level at which the actual comparator changes its output. 
This will prevent very small outputs dominating the figure 
of merit calculation. Figure 5 shows an example of a 
nominal signal (a) before and (b) after the hyperbolic 
tangent function is applied. Of course, whilst these steps 
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are described with reference to x 0 (t), which is the 
analogue response of the fault free CUT, they are also 
carried out for xi(t), which is the analogue response for 
the modelled faulty circuit. Hence, the nominal signal 
5 xci(t)for the faulty CUT is also defined by: 

xci(t)=taiih{ [xiO-compJ/xj} 

After being acted on by the sigmoidal function, the 
10 signals are then multiplied together at a multiplier stage 
36. The product of the two signals is then acted on by a 
tolerance confidence function to take into account 
tolerances in the CUTS. In the present case, the 
tolerance confidence function is multiplied 38 with the 
15 in-coming signal. 

Accounting for tolerances in analogue circuits is 
important, because the performance of each component can 
vary with certain tolerance band. This can result in a 
family of valid responses, as shown in Figure 6. Any 
20 faulty response should be distinguished from all of these 
family members. 

In the actual test application mode, the analogue 
response is transformed to a digital response, which is 
equivalent to the crossings of the analogue response with 
25 the time axis, by comparing the analogue response with the 
comparator threshold level. The effect of tolerances has 
an impact on these crossings. Consequently, the spread of 
time-axis crossings due to tolerances is acceptable. 
Therefore, this spread in time-axis crossings is non- 
30 diagnostic and should be excluded from the evaluation of 
the figure of merit. The region of the- spread of time-axis 
crossings due to tolerances at certain comparator level is 
defined by tolerance limits function Tol(t), where Tol(t) 
is zero in the tolerance region and unity anywhere else. 
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Figure 7 illustrates an example of Tol(t) with the 
comparator set to zero. 

The family of circuits due to tolerances is large and 
as will be appreciated increases as the number of 
5 components increase. Several methods are used to reduce 
the number of these circuits and to derive the tolerance 
limits function Tol(t) to be used in the final Figure-of- 
Merit. For example, the worst-case tolerances can be used 
to identify the upper /lower tolerance combinations, which 

10 correspond to max/min envelopes of the tolerance 
responses, as depicted in Figure 8. Alternatively, 
sensitivity analysis can be used to identify the extreme 
combinations of worst-case tolerances. This .analysis 
identifies the polarity of a component deviation such that 

15 the equivalent time-axis crossings are increased or 
decreased. 

Once the signal of Figure 4 is processed to take into 
account tolerances, it is then half wave rectified 40 to 
retain only the negative values, which values are 

20 indicative of the actual Hamming distance. Afterwards, the 
negative values are summed and normalised 42 by the number 
of the input signal samples. These negative values of the 
product of a good and a faulty response represent those 
time durations where a polarity difference exists between 

25 them. This is because if one of the two- responses is 
positive and the other is negative then their product will 
be negative and if they are both positive or both negative 
then their product will be positive. Once time durations 
due to tolerances are removed from the product, the 

30 resulting negative values are diagnostic and provide an 
indication of how much the responses of the good and 
faulty circuits differ. 

Figure 4 provides a mechanism for determining the 
differences between a fault free and a single faulty 
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circuit, thereby to establish a figure of merit. In 
practice, however, it is likely that CUTs have a range of 
potential faults and each CUT may include more than one of 
these. It is therefore important to have a figure of 
5 merit that is sensitive and robust enough to detect and 
identify any of that range of different faults in a given 
CUT. 

Figure 9 shows an arrangement for determining a 
figure of merit for an input signal to detect faults in a 

10 CUT. As for Figure 4, this is a diagrammatic 

representation of methodology that is implemented in 
software. In the methodology of Figure 9, the input 
signal is passed through a good CUT to provide .an ideal 
response and likewise through each of a plurality of 

15 modelled faulty circuits, each of the modelled faulty 
circuits having a known but different fault or combination 
of faults. The selection of the faults to test for 
depends on the nature of the CUT and the components used 
in it. Each of the resultant signals for the faulty CUTs 

20 is then processed as described with reference to Figure 4 
to provide a value Di that is a measure of the difference 
between the response of a faulty circuit I and the 
response of a good circuit. The output of the differencing 
is then acted on by a sigmoidal function, to prevent any 

25 given fault from dominating the overall figure of merit, 
to produce a figure of merit for each faulty CUT. As 
before, any reasonable input-output function can be 
employed for this, the requirements being that the output 
should saturate at two different predetermined values for 

30 extreme values of input. In between these saturation 
regions, the function should preferably increase 
monotonically, and hence be single-valued. The hyperbolic 
tangent has worked well but other functions might be 
equally suitable. These figures of merit are then summed 
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and divided by the number of modelled faulty CUTs, thereby 
to provide a composite figure of merit. 

For the arrangement of Figure 9, if x t (f) is the i th 
faulty response, where, i =1 to F faults, then the 
5 difference Di between the i th faulty response and the valid 
responses is defined by: 

10 where, d(J) = « 0 U)* xc f (j)*Tol(j) for xc 0 U)*xc,U)*Tol(J) <0, and 
d(j) = 0 elsewhere and n is the number of samples of the 
input test-signal. 

The ability to detect individual faults is combined 
into a single composite figure of merit. The individual 

15 figures of merit for each fault are most easily combined 
through summation, possibly weighted according to the 
importance of each fault and/or the expected probability 
of occurrence. If the figure of merit for each fault is 
acted on by the sigmoidal function before such 

20 combination, then the optimisation procedure will tend not 
to increase that individual figure of merit once it 
achieves the specified saturation level. Optimisation thus 
concentrates on achieving adequate performance over all 
faults rather than improving even further those faults, 

25 which are already adequately recognised. 

In practice, the final figure of merit may be defined 

by: 

FoM=-(l/F) *sum( [tanh(Di/D s ) ]) , where i=l -.number of faults F 

30 

The hyperbolic tangent function (tanh) is used as an 
example of the sigmoidal function. The value of D s is 
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different from x s . D s is the value of the difference 
saturation level, and is chosen to ensure that more than 
an adequate measure of a fault does not contribute much 
more to the composite figure of merit (for example, after 
20% measure of a fault difference, there will not be much 
more contribution to the composite figure of merit) . It 
should be noted that the minus sign ensures a positive 
value of FoM r since individual differences are negative 
valued. 

The f igure-of-merit described above is immune to very 
large single fault differences. This is achieved by using 
the first sigmoidal function. It is also designed to 
prevent fault domination by using the second sigmoidal 
function with D s . Hence, a well-detected fault does not 
contribute much more to the final f igure-of-merit than an 
adequately detected fault. 

The f igure-of-merit described above can measure how 
well a digital input sequence can detect faults and its 
fault coverage, i.e. how many faults it can detect. Since 
each fault contribution is acted on by the sigmoidal 
function, it has a maximum contribution to the composite 
figure of merit of unity (before normalisation by the 
number of faults) . Thus, the proximity of each fault 
contribution to unity indicates how well it has been 
detected. The proximity of the normalised {by the total 
number of faults) composite figure of merit to unity 
indicates how well all faults are detected and thus how 
many are not. 

The figure of merit is normalised to a number ranges 
from zero to one. This allows the hill-climbing 
optimisation algorithm to develop by knowing in advance 
the maximum allowed value, which is unity. The figure of 
merit is also directly related to the Hamming distance, 
which is used in actual test circumstances. 
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The figures of merit, obtained in the manner 
described above, are used in the search algorithm in order 
to determine the optimum input sequence. The optimisation 
search can be considered a hill-climbing optimisation 

5 problem. A simplified flow chart of the algorithm is 
shown in Figure 10. Before running the algorithm, it is 
necessary firstly to have a description of the CUT and a 
list of faulty circuits. To identify characteristic 
performances for a given input sequence, the fault free 

10 and modelled faulty CUTs are tested either using the 
circuit of Figure 9 or modelled. The modelled behaviour 
can be provided, for example, using the well-known MALAB 
programming tool, which can generate input sequences, 
simulate CUTs and simulate output signals. As before, the 

15 modelled faulty circuits may include circuits that have 
faults on a single component /parameter or on multiple 
components/parameters, these faults being selected on the 
basis that they are the most likely to occur for a given- 
circuit . 

20 To optimise the input signal, the algorithm starts by 

identifying a good initial binary sequence that is either 
arbitrarily chosen or based on prior knowledge of the 
circuit 42. This is applied to the arrangement of Figure 
9 to determine the composite figure of merit for that 

25 input. One or more predetermined techniques are then 
applied to modify the initial sequence by, for example, 
varying the pulse width of at least one pulse in the 
sequence. Incremental changes are made in the timing of 
the transition points from high to low to give a number of 

30 potentially improved sequences 46. Each of these is then 
applied to the fault free and faulty CUTs. Once this is 
done, all possible values of the comparator threshold are 
scanned 48. For each threshold value, the figure of merit 
is determined 50, and the comparator threshold that gives 



30 



WO 03/107019 



PCT/GB03/02599 



the highest figure of merit is selected. The best 
comparator threshold is used to calculate the composite 
figure of merit for each input sequence, thereby to 
summarise its ability to detect the full range of faults, 

5 The input with the highest figure of merit is selected and 
retained 54. If this is the initial sequence then the 
algorithm terminates 44. If the selected sequence is not 
the initial sequence, then the algorithm starts again 
using the sequence with the highest figure of merit as the 

10 initial sequence. In this case, however, the size of the 
incremental change' is varied 56. This process continues, 
with the step size being varied, until the selected 
sequence is the initial sequence, at which stage the 
algorithm terminates. 

15 Given a CUT description, with component/parameter 

values, the frequency bandwidth of the CUT and a set of 
potential faults, which covers the most probable defects 
that may occur during the manufacturing process, the hill 
climbing algorithm in effect sets out to search for and 

20 find an optimised set of binary sequences. Each sequence 
targets a group of faults, with associated comparator 
threshold level (s), to maximize the figure-of -merit and 
consequently the fault detection ratio. Variables include 
the integer run lengths of the binary sequences. This 

25 multidimensional problem may have more than- one peak and 
the shape of its surface is completely unpredictable. 

A more detailed description of the optimisation or 
search algorithm will now be given. 

As will be appreciated, the response of a given CUT 

30 with faults differs from that of the fault-free circuit at 
certain frequencies. Consequently, the applied test signal 
should probably have more energy within these frequencies 
and be located at the part of the spectrum that is most 
sensitive to faults. Hence, to select good starting 
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sequences , the search algorithm is operable to implement 
an exhaustive search examining all relevant binary 
sequences of limited lengths (i.e. number of bits) and 
different fundamental frequencies and selecting the most 

5 appropriate of these. Any binary sequence has two main 
properties, the length (i.e. number of bits) and the time 
duration, which is the reciprocal of the fundamental 
frequency of the sequence. If the number of bits is fixed 
and the time-duration of the bit is changed, then the 

10 whole sequence will be changed. For example, consider a 
binary sequence of 4 bits, one possible combinations of 
these bit is 1001. Then, the sequence 1001 with bit 
duration of 1 second is not the same as 1001 with bit 
duration of 2 seconds. The possible sequences of 4 bits 

15 are (e.g. 0000, 0001, 0011, 0010, 0111, 1001, and etc). 
If the bit duration is changed, each of these will result 
in another sequence. The total sequence duration (number 
of bits x bit duration, e.g. 4x1 second = 4 seconds) is 
the reciprocal of the sequence fundamental frequency. If 

20 the length is fixed, then the frequency can have many 
values,. and consequently many values of the bit durations. 
If the length and the frequency are fixed, then all 
possible combinations of the sequence bits (e.g. 0000, 
0001, 0011, 0010, 0111, 1001, and etc) can be considered. 

25 The best length, or the best frequency or the best 

combination of bits within a sequence is not known in 
advance. Therefore, the purpose of the exhaustive search 
is to find a sequence or more sequences of good 
performances. As the number of bits increases, the number 

30 of their possible combinations increases, e.g. for 32 
bits, there may be 2 32 combinations, which is about one 
billion sequences. So, the lengths, i.e. the number of 
bits, of the sequences considered is kept to a small 
number, so that all of their combinations can be 
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evaluated. Multiple lengths with multiple fundamental 
frequencies are considered for the exhaustive search. For 
each frequency, for each length and for each possible 
sequence a figure of merit is determined. 

5 More particularly, the exhaustive search involves 

selecting a number of frequencies covering the bandwidth 
of the CUT, which is in practice known, and generating a 
plurality of unlabelled binary sequences of small lengths, 
e.g. up to 16 bits. A first one of the selected 

10 frequencies is then selected and for every one of the 
plurality of binary sequences the bit duration is set to 
(1/length) x (1/f requency) . Once this is done, a figure of 
merit is calculated for every unlabelled sequence of a 
given length. The sequence having a maximum figure of 

15 merit for that particular length and frequency is then 
determined. This is repeated for every length. Once this 
is done, the sequences having a maximum figure of merit 
for every length and one frequency are determined. The 
whole process is then repeated for the next frequency 

20 until all pre-selected frequencies are tested. Then, the 
sequences that have the maximum figures of merit for every 
length and all frequencies are determined. The number of 
obtained sequences is the number of lengths considered. 
In this way, a group of initial sequences can be 

25 determined. 

It should be noted that to remove redundancy, 
sequences that are equivalent under rotation and/or 
inversion are not considered in the exhaustive evaluation. 
Since both input and output sequences are periodic, the 

30 choice of the starting position within the input sequence 
is arbitrary. This means that the rotation of a given 
binary sequence by any position in both directions will 
not change the effect of that binary sequence (1101 is the 
same as 1011) . Furthermore, at least for linear circuits, 
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inversion of a binary sequence provides no additional 
information (1000 is the same as 0111) . Therefore, it is 
necessary to consider only those sequences that are non- 
equivalent under rotation and/or inversion. 

The set of non-equivalent under rotation and/or 
inversion binary sequences are known in combinatorial 
mathematics as unlabelled binary necklaces. These are 
described in the article "Classes of Periodic Sequences" 
by Fine, Illinois J. of Math, Vol. 2, pp. 285-302, 1958. 
For example, the set of unlabelled necklaces of four bits 
is {0000, 0001, 0011, and 0101}. The number of unlabelled 
necklaces of number of 16 bits equals 2068. During initial 
investigations, the sequence length was sufficiently 
limited to 16 such that it would be possible to generate 
and then stimulate the CUT with all relevant sequences, 
which meet the predetermined constraints. 

The exhaustive search can be summarised as follows: 



-select number of frequencies covering the bandwidth of 
the CUT 

-generate unlabelled binary sequences of small lengths 
(e.g. up to 16 bits) 
-for every frequency 
for every length 

set bit duration to ( 1/length) x ( 1/f requency) 
for every unlabelled sequence of a given length 

calculate the Figure-of-Merit 
end 

find the sequence of maximum Figure-of-Merit 
(for particular length and frequency) 
end 

find the sequences of maximum Figure-of-Merit 
(for every length and one frequency) 
end 
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-find the sequences of maximum Figure-of -Merit (for every 
length and all frequencies) 

// The number of obtained sequences is the number of 
lengths considered // 

Once the exhaustive search is completed and good 
starting sequences are identified, the algorithm is 
operable to carry out a local search. This is done using a 
direct-search optimisation strategy, such as the algorithm 

10 of Hooke and Jeeves [Hooke, R. and Jeeves, T. A.: "Direct 
Search Solution of Numerical and Statistical Problems", 
Journal of the Association for Computing Machinery, Vol. 
8, pp. 212-229, 1961] . However, any other optimisation 
strategy could be applied. The local search can be 

15 considered an n-dimensional hill-climbing problem, in 
which each dimension corresponds to one runlength Ri of 
the binary sequences. Two distinct adjustments to the 
input sequence can be made, these being exploratory moves 
and pattern moves. Any binary sequence is a series of n 

20 runs R± with alternating polarities. Each run is the 
number of consecutive bits with same polarity. The 
transitions of po.larity occur at time 

n 

T lf where T, = X#, 
/=i 

Assuming the amplitude of the input binary sequence is 
25 ±A, (although a non-symmetrical binary signal may be used) , 
then this sequence can be described by the set of runs {Ri 
R2 ... R n , where. Rt is an integer}. Figure 11 shows a binary 
sequence in which various runlengths R lf R 2 , and R N are 
shown. By varying the length of the runlengths for input 
30 sequences and calculating and optimising the figure of 
merit for each of these sequences, a hill-climbing search 
is conducted. 
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The local search algorithm starts with the initial 
binary sequence selected by the exhaustive search, for 
example R s = Ri R2...Rn, where n is the number of runlengths. 
Each runlength is adjusted in turn by a fixed step +AR. If 

5 increasing the first run length by +AR results in an 
increased figure of merit, the change is retained. If not, 
the first runlength is changed by - AR. In the event that 
this change results in an increased figure of merit, then 
the change is retained. In contrast, if changing the first 

10 run length by -AR fails to improve the figure of merit, 
then R s is not changed. This is repeated for all 
runlengths of the sequence. After adjusting all runlengths 
Ri...to...R n , if no new sequence is established, the step size 
is reduced and the exploratory moves are repeated. If a 

15 new sequence R 3+1 has been established, this is used as the 
new base point for a pattern move. 

To implement a pattern move, the local search 
algorithm is operable to apply a shift function to the 
sequence that is output from the initial exploratory 

20 steps. A shift function moves the whole pattern in the 
search space, not a shift of the test sequence in time 
domain. For example, if Rl = [5 5 10 10] and R2 = [2 2 2 
2], then a pattern shift of Rl by R2 may be as: R3 = 2R1 - 
R2 = [B 8 18 18]. More generally, the pattern move may be 

25 for example R S+2 =2R S+1 -R 3 , where R s+2 is the result of the 
pattern move. Once the pattern is shifted to R s+2 , the 
exploratory steps described previously are repeated 
- starting with R s+2 , that is the runlengths are each varied 
in turn in order to identify the sequence with the maximum 

30 figure of merit. If the exploratory steps fail to improve 
the figure of merit of R s+2 , R s+1 is used as a starting 
sequence and the exploratory steps are conducted. If the 
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exploratory steps succeed to improve the figure of merit 
of R s+2 , a new sequence R s+3 will be established and R s+3 & 
R s+1 are considered for a further pattern shift to be 
applied. The algorithm repeats this process until the step 

5 size equals a pre-determined minimum allowed value. 
Alternatively, the local search could be continued until 
no further improvement occurs. 

It should be noted that in the local search, if the 
step size is small, the algorithm is forced to search the 

10 nearby region, and may be stuck at a bad locale. If the 
step size is large, the algorithm may overlook a promising 
optimum. Therefore, using a variety of step sizes is 
recommended. The step sizes could be pre-determined or 
determined dynamically as the search progresses. Using 

15 several different step sizes when changing the signal 
incrementally could improve the probability of 
convergence, rather than changing the signal by the same 
amount each time. To improve the result of the local 
search, the obtained solution in one iteration is 

20 considered as a starting sequence for a new iteration of 
the local search. This process is repeated until no more 
improvement occurs. At the start of each iteration, the 
step size of the change is resumed to its initial value. 
The local search can be summarised as follows: 

25 " ========= = = = - ======== 

Set s=0, an index for sequences 

R s = Ri R 2 ...Rn, sequence of n runlengths (pulses) 
While (better figure of merit) repeat 
While (better figure of merit), repeat steps (1) : (5) 
30 (1) //Exploratory moves// 

• i=l 

• (a) Adjust runlength R s i by a fixed step +AR to give 

p3 test 
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• If (better figure of merit), 

retain this change i.e R s+1 = R s - test 
and go to (b) 

• Else, change R s i by -AR to give new R s - test 
5 o If (better figure of merit), 

retain this change i.e R s+1 = R s - test 
and go to (b) 

o Else, keep R s unchanged i.e. R s+1 = R 8 and go to 
(b) 

10 • (b) i=i+l 

• If i=n, go to (2) 

• If i*n, go to (a) 

(2) If a new vector has been established 
R s = R s+1 

15 i.e. use this new vector as the new base point for the 

pattern move and go to (4) 

(3) else (If a new vector has not been established) 

Vary the step size AR (unless it is already the 
minimum value, in this case exit inner while loop with 
20 best result) , for example by reducing it, and repeat 

the exploratory moves i.e go to (1) 

(4) Pattern move: 

Move the pattern R 3 " 1 by the result of the exploratory 
moves R s using a predefined function to give R s+1 , for 
25 example, R S+1 =2R S -R 5 " 1 

(5) make exploratory moves i.e. go to (1) with the new 
sequence obtained 

end the inner while loop 

end the outer while loop (terminate the algorithm) 

Once the local search is completed, a local maximum 
in the figure of merit surface is identified. To optimise 
the search further, the algorithm is adapted to do a fine 
or neighbourhood search around this local maximum. The 
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neighbourhood search involves applying positive and 
negative changes of unity step size in all indices of the 
input sequence and evaluating all possible combinations of 
changes. More specifically, the neighbourhood search 

5 starts by using the input sequence that corresponds to the 
local maximum identified by the local search. Fixed 
changes are then applied in all dimensions of the starting 
sequence simultaneously. This could for example involve 
changing every runlength in the sequence simultaneously by 

10 1 to provide a first modified sequence and then changing 
every runlength in the sequence simultaneously by -1 to 
provide a second modified sequence and so on until all 
possible combinations of +1, -1 and zero are made. Once 
this is done, the figure of merit for all modified 

15 sequences is determined, and the sequence having the 
maximum figure of merit is retained. This process is 
repeated until no further improvement occurs, thereby 
guaranteeing that the obtained solution is the top of the 
local hill. 

20 The neighbourhood search can be summarised as 

follows: 



while improving 

-apply all possible combinations of (0, +1 and -1) 
25 changes in all dimensions of 

the starting sequence simultaneously 
-calculate Figure-of-Merit for all modified sequences 
-keep the sequence of max Figure-of -Merit 

end 

30 

Once the neighbourhood search is completed, the local 
search process is then repeated for the next of the range 
of starting sequences, as is the neighbourhood search, so 
that the highest of the figures of merit is obtained for a 



39 



WO 03/107019 



PCT/GB03/02599 



variety of different input sequences. As will be 
appreciated, the shape of the hill surface is completely 
unpredictable. When the final sequence is analysed, the 
maximum composite figure of merit for all of the tested 

5 sequences is determined and the sequence that this 
corresponds to is identified as being the optimised 
signal. In some cases, once the signal is optimised, the 
entire process is repeated, but with well-detected faults 
removed from the tested fault list. This is done on the 

10 basis that well detected faults can be readily detected 
and so the optimisation should focus on those faults that 
are more difficult to identify. A second input sequence 
may be optimised exclusively for these difficult to 
identify faults. 

15 The main features of the test method and the 

optimisation algorithm described herein are summarised in 
Figure 18. The algorithm provides a robust and effective 
method for identifying an optimal digital test signals for* 
an analogue or mixed signal circuit. It uses a coarsely 

20 quantised exhaustive search to find good starting 
sequences on the f igure-of-merit hill. Once this is done, 
a local search is conducted during which the runlengths of 
the input sequences are varied using several different 
initial step sizes, thereby to improve the probability of 

25 convergence. This is repeated until- no further 

improvement occurs . A neighbourhood search is then done 
on the output of the local search by applying zero and ± 
change of unity step size in all indices of the input 
sequence and evaluating all possible combination of 

30 changes. This is done to guarantee that the top of a local 
hill can be identified. Well-detected faults are then 
identified and dropped and the whole process is repeated 
for the remaining faults. This is because it is unlikely 
to have one sequence that detects all faults. 
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An enhancement to the methodology presented herein 
provides a solution to the tricky problem of measuring the 
gain of a CUT. However, it does not require optimisation. 
For a dc CUT, in which the frequency of the input test 

5 signal has no effect on the behaviour of the CUT, the 
input signal offset and amplitude can be found by 
calculation, or iterative binary chop similar to 
successive approximation analogue-to-digital conversion . 
For ac coupled circuits, in which the behaviour of the CUT 

10 is dependent on frequency, the mark space ratio of the 
input digital signal can be adjusted to set the dc offset 
and the gain is adjusted as before. The input offset and 
amplitude are selected such that for a low gain, the whole 
output signal is below the threshold. In the event that 

15 the gain is too high, the whole output is above the 
threshold and only when the gain is within the correct 
range is the threshold crossed by the output as per the 
example in Figure 17. 

In order to test the method in which the invention is 

20 embodied, a second-order Sallen-Key active low pass filter 
(LPF) having a cut-off frequency of 2KHz (Kilo Hertz) was 
selected. An example of this is shown in Figure 13. The 
gain bandwidth product of the operational amplifier was 
assumed to be 10MHz (Mega Hertz) . Various faults 

25 including parametric deviation, open, and short-circuits 
were considered for simulation. The values of faults were 
chosen to satisfy the stability condition of the LPF. The 
MATLAB programming tool was used for input sequence 
generation, circuit simulation and output processing. 

30 Figure 14 shows the frequency response of the three cases: 
(a) fault-free, (b) worst case tolerances and (c) 22 
faulty circuits. It is clear from this that the region at 
which most of the faults have the greatest difference from 
that of the fault-free response is around the cut-off 
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frequency. Thus, the optimum stimulus is likely to have 
most of its power concentrated at those frequencies around 
cut-off. 

The binary sequence for stimulating the CUT was 
5 identified through the optimisation algorithm. For the 
sake of simplicity, the components tolerances were not 
included. However, they can be easily incorporated in the 
calculation of the composite figure of merit. Setting the 
comparator of the test system at zero threshold, it was 
10 found that the binary sequence of the maximum value of the 
composite figure of merit had the following 
characteristics : 

• Number of bits =53. 

• Bit duration or clock interval = 10 pSec. 

15 • Runlength of [+34 -11 +5 -3] , where the sign is the 

polarity and the associated number is the runlength 
(the number of consecutive bits of same polarity) . 
The oversampling ratio was chosen to be unity. The 
optimised input sequence was repeated until the output 

20 voltage of the CUT settled. The settling time should be 
larger than the slowest settling time of the faulty 
circuits. For this particular circuit and set of faults, 
the settling time was less than 10ms (milli second) . 

The optimised input binary sequence stimulated all 

25 the CUT configurations. The output analogue responses were 
then one-bit quantised by the output comparator with 
reference at zero. The resulting faulty binary sequence 
was then compared against the sequence of the fault-free 
CUT. Figure 15 shows the simulation results for one fault 

30 (Rl+30%) as time domain responses. Figure 16 shows a table 
of simulation results for all 22 considered faults, where 
the Hamming distance for each fault is shown graphically 
and numerically. Figure 16 shows that the timing of the 
output binary sequence is affected by the presence of a 
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fault in the CUT. In Figure 16, the timing comparison is 
made against that of an ideal fault-free CUT (all 
components are in their nominal values) . However, in 
practice this is not the case. Differences in some 
5 timeslots due to components tolerances are non-diagnostic 
and should be excluded from the evaluation. From Figure 
16, it can be seen that most of the faults could be 
detected. 

According to the invention, there is provided a 

10 method for optimising a digital test signal for testing 
analogue or mixed-signal circuits and a method for using 
the optimised signal to test analogue and/or mixed-signal 
circuits. Numerous advantages are provided by the 
invention. For example, it provides robust testing with 

15 wide fault coverage, including parametric failures. 
Because of the efficiency of the testing, the method also 
allows rapid device throughput. The method is also suited 
to integrated circuit testing where routing analogue test 
signals is problematic. In addition, the method can be 

20 implemented using minimal on-chip overhead and cheaper, 
digital, external test equipment. Furthermore, minimal 
time is needed to design the test procedure. The skill 
level required by the test procedure designer is reduced 
and the process could be fully automated. There is also 

25 scope to include test and verification circuitry on-chip 
giving complete built in test capability. Additionally, 
there is a reduced demand for expensive test equipment. 
Yet another advantage is the reduction of the hardware 
needed for stimulus generation and response processing in 

30 the test application mode to a single comparator and some 
comparison logic. This greatly simplifies testing and 
increases manufacturing throughput. 

A skilled person will appreciate that variations of 
the disclosed arrangements are possible without departing 
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from the invention. In particular, whilst the search or 
optimisation algorithm is described as being a hill- 
climbing algorithm, other suitable techniques could be 
used. For example, techniques from artificial intelligence 

5 could be employed for optimisation. This is equivalent to 
searching for best examples within constraints. 
Evolutionary computing techniques such as genetic 
algorithms may also be useful. In a simple sense, such 
approaches do not have specific rules for modification and 

10 may have an element of random change. Frequently a large 
population of candidates is maintained concurrently. 
These techniques do not have formal algorithms and take 
advantage of the increased power, i.e. memory and 
execution speed of modern computers. In addition, whilst 

15 in the examples described a simple two state input signal 
is investigated, it will be appreciated that other more 
complex inputs could be used. Additionally or 
alternatively, the simulations could be adapted to take 
into account the rise time of the digital signal when it 

20 switches between digital states, so that the real time 
behaviour of the circuit can be modelled more accurately. 
Furthermore, as a modification to the test system 
described above, it will be appreciated that a single 
digital input source could be used to test a plurality of 

25 different electronic functions or subsystems ■ having inputs 
that are connected to a single interconnected. To do 
this, the arrangement shown in Figure 19 could be used. 
This allows a single test signal to be sequentially 
applied to each of the analogue sub-systems. 

30 Alternatively, a single test signal can be applied to a 
selected one of the circuits. In any case, a single 
detector is provided for analysing the resultant outputs. 
By sharing functionality in this way, the size and cost of 
the test arrangement can be minimised. Accordingly, the 
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above description of a specific embodiment is made by way 
of example only and not for the purposes of limitation. 
It will be clear to the skilled person that minor 
modifications may be made • without significant changes to 
5 the operation described above. 
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